Adapting Multiple-Choice Item-writing Guidelines to an Industrial Context
نویسنده
چکیده
This paper proposes a guideline for writing MCQ items for our domain which promotes the use of Multiple Alternative Choice (MAC) items. This guideline is derived from one of the guidelines from the Taxonomy of item-writing guidelines reviewed by Haladyna et al, 2002. The new guideline is tested by delivering two sets of MCQ test items to a representative sample of candidates from the domain. One set of items complies with the proposed guideline and the other set of items does not. Evaluation of the relative effectiveness of the items in the experiment is achieved using established methods of item response analysis. The experiment shows that the new guideline is more applicable to the featured domain than the original
منابع مشابه
A Review of Multiple-Choice Item-Writing Guidelines for Classroom Assessment
A taxonomy of 31 multiple-choice item-writing guidelines was validated through a logical process that included two sources of evidence: the consensus achieved from reviewing what was found in 27 textbooks on educational testing and the results of 27 research studies and reviews published since 1990. This taxonomy is mainly intended for classroom assessment. Because textbooks have potential to e...
متن کاملThe frequency of item writing flaws in multiple-choice questions used in high stakes nursing assessments.
Multiple-choice questions are a common assessment method in nursing examinations. Few nurse educators, however, have formal preparation in constructing multiple-choice questions. Consequently, questions used in baccalaureate nursing assessments often contain item-writing flaws, or violations to accepted item-writing guidelines. In one nursing department, 2770 MCQs were collected from tests and ...
متن کاملEvaluation of Five Guidelines for Option Development in Multiple-choice Item-writing Evaluation of Five Guidelines for Option Development in Multiple-choice Item-writing Evaluation of Five Guidelines for Option Development in Multiple-choice Item-writing
Non-profit academic project, developed under the open access initiative Multiple-choice items are used extensively in classroom achievement tests. This explains the importance attributed to understanding how to write these items correctly. Multiple-choice test items may be presented in a question or completion format, with negative, positive, simple or complex sentences, with language that is m...
متن کاملEducation techniques for lifelong learning: writing multiple-choice questions for continuing medical education activities and self-assessment modules.
The multiple-choice question (MCQ) is the most commonly used type of test item in radiologic graduate medical and continuing medical education examinations. Now that radiologists are participating in the maintenance of certification process, there is an increased need for self-assessment modules that include MCQs and persons with test item-writing skills to develop such modules. Although princi...
متن کاملEvaluation of five guidelines for option development in multiple-choice item-writing.
This paper evaluates certain guidelines for writing multiple-choice test items. The analysis of the responses of 5013 subjects to 630 items from 21 university classroom achievement tests suggests that an option should not differ in terms of heterogeneous content because such error has a slight but harmful effect on item discrimination. This also occurs with the "None of the above" option when i...
متن کامل